arXiv:1509.04784vl [math.OC] 16 Sep 2015 


Mean Square Capacity of Power Constrained Fading Channels with 

Causal Encoders and Decoders* 


Liang Xu^, Lihua Xie^ and Nan Xiao^ 


Abstract —This paper is concerned with the mean square 
stabilization problem of discrete-time LTI systems over a power 
constrained fading channel. Different from existing research 
works, the channel considered in this paper suffers from both 
fading and additive noises. We allow any form of causal channel 
encoders/decoders, unlike linear encoders/decoders commonly 
studied in the literature. Sufficient conditions and necessary 
conditions for the mean square stabilizability are given in 
terms of channel parameters such as transmission power and 
fading and additive noise statistics in relation to the unstable 
eigenvalues of the open-loop system matrix. The corresponding 
mean square capacity of the power constrained fading channel 
under causal encoders/decoders is given. It is proved that 
this mean square capacity is smaller than the corresponding 
Shannon channel capacity. In the end, numerical examples are 
presented, which demonstrate that the causal encoders/decoders 
render less restrictive stabilizability conditions than those under 
linear encoders/decoders studied in the existing works. 

1. Introduction 

Control over communication networks has been a hot 
research topic in the past decade [1]. This is mainly mo¬ 
tivated by the rapid development of wireless communication 
technology that enables the connection of geographically 
distributed systems and devices. However, the insertion of 
wireless communication networks also poses challenges in 
analysis and design of control systems due to constraints 
and uncertainties in communications. One must take the 
communication networks into consideration and analyze how 
they affect the stability and performance of the closed-loop 
control systems. 

Until now, there have been plentiful results that reveal 
requirements on communication channels to ensure the sta¬ 
bilizability. For noiseless digital channels, the celebrated data 
rate theorem is given in [2]. For noisy channels, the problem 
is complicated by the fact that different channel capacities 
are required under different stability definitions. For almost 
sure stability, [3] shows that the Shannon capacity in relation 
to unstable dynamics of a system constitutes the critical 
condition for its stabilizability. While for moment stability, 
[4] shows that the Shannon capacity is too optimistic while 
the zero-error capacity is too pessimistic, and the anytime 
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capacity introduced in this paper characterizes the stabiliz¬ 
ability conditions. Essentially, to keep the r^-moment of the 
state of an unstable scalar plant bounded, it is necessary 
and sufficient for the feedback channel’s anytime capacity 
corresponding to anytime-reliability a = 7^1og2|A| to be 
greater than log 2 1 A|, where A is the unstable eigenvalue of the 
plant. The anytime capacity has a more stringent reliability 
requirement than the Shannon capacity. However, it is worthy 
noting that there exist no systematic method to calculate the 
anytime capacities of channels. 

In control community, the anytime capacity is usually 
studied under the mean square stability requirement, for 
which the anytime capacity is commonly named as the 
mean square capacity. For example, [5] characterizes the 
mean square capacity of a fading channel. [6] studies the 
mean square stabilization problem over a power constrained 
AWGN channel and characterizes the critical capacity to 
ensure mean square stabilizability. They further show that 
the extension from linear encoders/decoders to more general 
causal encoders/decoders cannot provide additional benefits 
of increasing the channel capacity [7]. Specifically, the 
results stated above deal with fading channels or AWGN 
channels separately. While in wireless communications, it 
is practical to consider them as a whole. In this paper, 
we are interested in a power constrained fading channel 
which is corrupted by both fading and AWGN. We aim 
to find the critical condition on the channel to ensure the 
mean square stabilizability of the system. Note that [8] has 
derived the necessary and sufficient condition for such kind 
of channel to ensure mean square stabilizability under a 
linear encoder/decoder. It is still unknown whether we can 
achieve a higher channel capacity with more general causal 
strategies. This paper provides a positive answer to this 
question. 

This paper is organized as follows. Problem formulation 
and some preliminaries are given in Section 2. Section 3 
provides the results for scalar systems. Section 4 discusses 
the extension to vector systems. Section 5 provides numer¬ 
ical illustrations and this paper ends with some concluding 
remarks in Section 6. 

H. Problem Formulation and Preliminaries 

This paper studies the following single-input discrete-time 
linear system 

xt+i = Axt + But ( 1 ) 

where x e is the system state and u e R is the control 
input. Without loss of generality, we assume that all the 



eigenvalues of A are unstable, i.e., |Ai(74)| > 1 for all i = 
1, 2,..., n [7]. The initial value xq is randomly generated 
from a Gaussian distribution with zero mean and bounded 
covariance • The system state Xt is observed by a sensor 
and then encoded and transmitted to the controller through 
a power constrained fading channel. The communication 
channel is modeled as 

rt = fft St + nt ( 2 ) 

in which St denotes the channel input; rt represents the 
channel output; {gt} is an i.i.d. stochastic process modeling 
the fading effects and {rit} is the additive white Gaussian 
noise with zero-mean and known variance The channel 
input St must satisfy an average power constraint, i.e., 
< P. We also assume that xq, • • • are 

independent. In the paper, it is assumed that after each 
transmission, the instantaneous value of the fading factor 
gt is known to the decoder, which is a reasonable assump¬ 
tion for slowly varying channels with channel estimation 
[9]. The instantaneous Shannon channel capacity is Ct = 
^ln(l + with Ct being measured in nats/transmission. 
The feedback configuration among the plant, the sensor and 
the controller, and the channel encoder/decoder structure are 
depicted in Fig. 1. In this paper, we try to find requirements 
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Fig. 1. Network control structure over power constraint fading channel 

on the power constrained fading channel such that there 
exists a pair of causal encoder/decoder {ft}^{ht} that can 
mean square stabilize the LTI dynamics ([T]), i.e., to render 

limt^oo^{xtX^} = 0 . 

To solve this problem, the following preliminaries are 
needed, which are borrowed from [7]. Throughout the paper, 
a sequence {xi}\=Q is denoted by x^; random variables are 
denoted by uppercase letters, and their realizations by lower 
case letters. All random variables are assumed to exist on a 
common probability space with measure V. The probability 
density of a random variable X in Euclidean space with 
respect to Lebesgue measure on the space is denoted by px , 
and the probability density of X conditioned on the a-field 
generated by the event Y = y Px\y expectation 

operator be denoted by E, and the expectation conditioned on 
the event Y = ^ by E^. We use log to denote the logarithm 
to the base two, and In to denote the natural logarithm. 

The differential entropy of X is defined hy H{X) = 
—E{lnpx}, provided that the defining integral exists. Denote 


the conditional entropy of X given the event Y = y hy 
Hy{X) = H{X\Y = y) = —Ey{ln.px\y}, and the random 
variable associated with Hy{X) by Hy{X). The average 
conditional entropy of X given the event Y = y and averaged 
over Y is defined by H{X\Y) = E{i7y(A)}, and the 
average conditional entropy of X given the events Y = y 
and Z = z and averaged only over Y hy Hz{X\Y) = 
Ez{Hy,z{X)}. The conditional mutual information between 
two random variables X and Y given the event Z = z 
is defined by Iz{X;Y) = H^{X) - H^{X\Y). Given a 
random variable X G with entropy H{X), the entropy 
power of X is defined by N{X) = Denote the 

conditional entropy power of X given the event Y = y hy 
Ny{X) = and the random variable associated 

with Ny{X) by Ny{X). The average conditional entropy 
power of X given the event Y = y and averaged over 

Y is defined by N{X\Y) = E{Xy(X)}, and the average 
conditional entropy power of X given the events Y = y 
and Z = z and averaged only over Y hy Nz{X\Y) = 
'^z{Ny,z{X)}. The following lemma shows that the entropy 
power of a random variable provides an estimation of the 
lower bound for its variance. 

Lemma 1 ([7]): Let X be an n-dimensional random vari- 
able. Then NyiX) < iEj,{||X||2}. 

Lemma 2: Let X be an n-dimensional random variable, 
f{X) be a function of X, and Y = /(X) -f- N with N 
being a random variable that is independent with X. Then 
I{X;Y) = I{f{X);Y). 

Proof: Since H{Y\X) = H{Y\XJ{X)) < 

H{Y\f{X)), we have H{Y) = I{X;Y) + H{Y\X) < 
I{X;Y) + H{Y\f{X)). Thus H{Y) - H{Y\f{X)) = 
I{Y; /(X)) < /(X; Y). Besides, noting that X ^ /(X) ^ 

Y forms a Markov chain, the data processing inequality [10] 

implies that I{X;Y) < I{f{X);Y). Combining the two 
facts, we have /(X; Y) = I{f{X); Y). ■ 

Remark 1: Lemma |2] indicates that for the AWGN chan¬ 
nel, the amount of information that the channel output con¬ 
tains about the source is equal to the amount of information 
that the channel output contains about the channel input. 

III. Scalar Systems 

To better convey our ideas, we start with scalar systems. 
Consider the following scalar system 

^t+i = Axt + Ut (3) 

where |A| > 1 and E{xq} = With the communication 
channel given in the stabilizability result is stated in the 
following theorem. 

Theorem 1: There exists a causal encoder/decoder pair 
{/t}, {/it}, such that the system © can be stabilized over 
the communication channel © in mean square sense if and 
only if 

loglAI < (4) 

Theorem indicates that the mean square capacity 

of the power constraint fading channel is Cm sc = 
— ^logEj ^2 }• In the following, we will prove the 















necessity and sufficiency of Theorem respectively. The 
proof essentially follows the same steps as in [11], [7], [12], 
however, with some differences due to the channel structure. 

A. Proof of Necessity 

The proof of necessity follows from the intuition below. In 
view of Lemma the entropy power provides a lower bound 
for the mean square value of the system state. We thus can 
use the average entropy power as a measure of the uncertain 
region of the system state and analyze its update. At time t, 
the controller maintains a knowledge of the uncertain region 
of Xt. When it takes action on the plant, the average uncertain 
region of predicated by the controller is expanded to 
times that of Xt. This is the iteration we term as dynamics 
update, which describes the update of the uncertain region 
of X maintained by the controller from time t to t + 1. After 
receiving information about Xt+i from the sensor through 
the communication channel, the controller can reduce the 
predication error of the uncertain region of Xt+i by a factor 
of E| o This is the iteration we term as communi- 

cation update, which describes the update of the uncertain 
region of x maintained by the controller at time t + 1 after 
it has received the information about from the sensor 
through the communication channel. Thus to ensure mean 
square stability, the average expanding factor A^E{ ^ 2 ^^ 2 p } 
of the system state’s uncertain region should be smaller than 
one, which gives the necessary requirement in Theorem 
The formal proof is stated as follows. Here we use the 
uppercase letters X, S', i?, G to denote the random variables 
of the system state, the channel input, the channel output and 
the channel fading coefficient. We use the lowercase letters 
X, s, r, ^ to denote their realizations. 

1) Communication Update: The average entropy power of 
Xt conditioned on is N{Xt\R\G^)=^{N 

where (a) follows from the law of total expectation and 
(6) follows from the definition of entropy power. Since 

^2H(Xt\Rt,R''~^=C~\G^=g^) 

^2{HiXt\R^-^=r^-\G*=g*)-I{Xt,Rt\R*-^=r^-\G^=g^)) 

if) ^2[H(Xt\R^-^=r^-^,G*=g*)-IiSt,Rt\R^~^=C~^,G^=g'')) 
^2{HiXt\R^-^=p-\G^=g^)-ct) 
^-2ct^2H{Xt\R^-^=C-\G^-^=g^-^) 

where (c) follows from Jensen’s inequality; (d) follows 
from the definition of conditional entropy; (e) follows 
from the definition of conditional mutual information; (/) 
follows from Lemma {g) follows from the definition of 
channel capacity, i.e., I{St, = g^) < Ct 

and (h) follows from the fact that Gt is independent with 
Xt, we have N(Xt\R\G^)>^E{e-‘^^te‘^^R^-^,Gt-^^^t)y^ 

n^2^^}N{Xt\R^-\G^-^). 


2) Dynamics Update: Since g^) _ 

^2H{XXt+Ut\R^=r\G^=g^) (J) ^2II(AXt\R*=P ,G*=g*) W 

^2ff(Xt\R^=P,G^=g^)-h2ln\A\ ^ y2^2ff(Xt\R^=P,G^=g^) 

(i) follows from the fact that Ut = ht{r^,g^) and (j) 
follows from Theorem 8.6.4 in [10], we have N{Xt+i\R\G^)> 

3) Proof of Necessity: Combining the results of 

communication update and dynamics update, we have 
N{Xt+i\R\G^)>\^¥.{ ^'f^ }N{Xt\R^-^,G^-^). In view of 
Lemma [Ij G^) should converge to zero 

asymptotically. Thus A^Ej^^X^^} < 1, which is 0 and 
this proves the necessity. 


B. Proof of Sufficiency 

To prove the sufficiency, we need to construct a pair of 
encoder and decoder. The encoder and decoder are designed 
following an ’’estimation then control” strategy. The con¬ 
troller consecutively estimates the initial state xq by using the 
received information from the channel and then applies an 
equivalent control to the plant. The reason for adopting such 
strategy is explained as follows. The response of the linear 
system is Xt = \^{xq - Xt) with Xt = - 
which means E{x|} = A^^E{(xo — Xt)‘^}. We can treat Xt 
as an estimate of the controller for the initial state xq. If the 
estimation error E{(xo — Xt)‘^} converges to zero at a speed 
that is greater than A^, i.e., there exists p > and a > 0, 
such that E{(xo —Xt)‘^} < the mean square value of the 

system state would be bounded byE{xf}<a^^^ . Thus 
lim E{xn = 0, i.e., system is mean square stable. This 

t^OO ^—' 

intuition can be formalized using the following lemma. 

Lemma 3 ([12]): If there exists an estimation scheme Xt 
for the initial system state xq, such that the estimation error 
Ct = Xt — Xq satisfies the following property. 


E{et} = 0 

lim A*E{ete't}{Ay = 0 


(5) 

( 6 ) 


then the system 0 can be mean square stabilized by the 
controller Ut = K (^A^Xt + Zi=i with K 

being selected such that A + BK is stable. 

When gt is known at the receiver, channel 0 resembles 
an AWGN channel. Shannon shows that when estimating a 
Gaussian random variable through an AWGN channel, the 
minimal mean square estimation error can be attained by 
using linear encoders and decoders, respectively [13]. And 
the minimal mean square error variance is given by p • 
Thus through one channel use, we can at best decrease the 


estimation error by a factor of 


j. Since gt is i.i.d.. 


we can transmit the estimation error from the decoder to 
the encoder and iteratively conduct the minimal mean square 

estimation process. Then the estimation error would decrease 

2 2 

on average at a speed of If A^E{ ^ 2 ^"ap } < 

1, in view of Lemma system 0 can be mean square 
stabilized. The estimation strategy actually follows the prin¬ 
ciple of the well-known scheme of Schalkwijk [14], which 











utilizes the noiseless feedback link to consecutively refine 
the estimation error. The detailed encoder/decoder design and 
stability analysis are given as follows. 

1) Encoder/Decoder Design: Suppose the estimation of 
xq formed by the decoder is Xt at time t and the estimation 
error is et = Xt — xq. The encoder is designed as 



-Xo), 


t > 1 


The decoder is designed as 


(7) 


f 0 = 



Xt = Xt-l - 




t > 1 


( 8 ) 


with representing the variance of e^-i. 

2) Proof of Sufficiency: Since vq = ^o«5o + in vi ew 

of (|7]) and we have cq = {go — l)xo + y 
Because go, xq, no are independent and xo, no follows a zero 
mean Gaussian distribution, we know that the conditional 
probability distribution of eo given the event go is Gaussian 

and E{eo|ffo} = 0, E{el\go} = {go - Thus 

E{eo} = E{E{eo|5oy = 0 and E{eg} = E{E{e§|5ro}} = 

E{(flo-l)^}< + %^. 

For t > 1, in view of ([7]( and (|^, we have 


et = et-i 


^{rtet-i\gt} 


-n 




nr1\gt} 

"^{rtet-Agt}' 




et-i 


E{rtet_i|g(} 

nrhgt] 


-nt 


Thus the conditional probability distribution for Cf given the 
event gt is Gaussian. We also have 


E{et} = E{E{et|5t}} 





E{r||5t} 

Ejnet-ilfff}^ 

E{r2|5*} 


where (a) follows from the fact that gt is independent with 
Ct-i. Since E{eo} = 0, we further know that E{et} = 0. 
The sufficient condition Q is satisfied. 

Since e^-i, gt and nt are independent, we have 
E{e^_i\gt} = and E{n^\gt} = E{n^}, which im- 

plies E{r^\gt} = E{{gtf^^et-i+nty\gt} = cfl + glP 

and E{rtet_i|p(} = E{et-i{gtf^ffet-i + nt)\gt} = 
Since E{e^\gt} = E{e?_i|pt} - ’ 

we also have E{el\gt} = E{e|_i} - = 

E{ef_i} ^ 2 +; 2 p . which implies E{e|} = E{E{e||pt}} = 


E{e?_i}E{^ 2 ^^}. Thus if X'^E{^^f^} < 1, the de- 
signed encocfer/decoder pair can guarantee (§. In view of 
Lemma the sufficiency of Theorem is proved. 

Remark 2: We can show that Cmsc is smaller than the 
Shannon capacity, which is Cshannon = Ejct} [9]. From 
Jensen’s inequality, we know that 

and the equality holds if and only if q is a constant. Thus 
it follows that CmSC = = 

E{ct} = ^Shannon and the equality holds if and only if q 
is a constant. 

Remark 3: By letting gt in Q be the Bernoulli distribu¬ 
tion with failure probability e, and taking the limit ^ 0 
and P ^ oo, we can show that the necessary and sufficient 
condition to ensure mean square stabilizability for the real 
erasure channel is e < which recovers the result in [5]. 
If we let gt be a constant with gt = 1, then the studied 
power constrained fading channel degenerates to the AWGN 
channel and the degenerates to ilog(l + &) < log|A|, 

^ 9 

which recovers the result in [4], [6]. If = 0 and the event 
gt = 0 has zero probability measure, the right hand side of 
0 becomes infinity. Then for any A, 0 holds automatically. 
This is reasonable since we have assumed that gt is known 
at the decoder side, thus if there is no additive noise, the 
channel resembles a perfect communication link. Since ^ 
is controllable, we can always find a pair of encoder and 
decoder to stabilize the system. 

IV. Vector Systems 

For vector systems, the situation becomes complicated by 
the fact that we have n sources Xi^o and only one channel, 
where Xi^o denotes the i-th element of xq. Firstly, we would 
analyze the achievable minimal mean square estimation error 
for estimating xo over the channel ^ during one channel 
use. Consider the following Markov chain 

Xo^St = ft{Xo) ^Rt^Xt = ht{Rt) 

where Xo G denotes the Gaussian initial state with 
covariance matrix ft{’) is a scalar-valued function 

denoting the channel encoder for 0; Rt denotes the channel 
output and Xt is the estimation of Xo formed by the decoder 
with decoding rule ht{'). 

Denote the estimation error as Ct = Xo — Xt, in view of 
Lemmaj^ we have ^trEjeteJ} > Since 

H{et\Rt) = H{Xo - ht{Rt)\Rt) = H{Xo\Rt) 

= H{Xo)-I{Xo;Rt) 

H{Xo) - I{ft{Xo)-,Rt) 

> Iln((27re)”det(S^J) - Iln(l + 

z z 

where (a) follows from Lemma thus we have 

ivE{eteO > n det(E^ J ( " 

From the above inequality, we know that the minimal mean 
square error is given in terms of g 2 pf ^2 • However, this 





























is only for the sum of the estimation errors with 
being the i-th element of e^. There is no indication on the 
convergence speed for every single Lemma implies 
that we should design the encoder/decoder to render that 
limt^ooAf^E{e?^} = 0 for all i, which places separate 
requirements for the convergence speed of each Thus we 
need to optimally allocate channel resources to each unstable 
state variable. 

The previous analysis also implies that we should treat the 
unstable modes of A separately. Here we focus on the real 
Jordan canonical form of system 0. Let Ai,..., be the 
distinct unstable eigenvalues (if A^ is complex, we exclude 
from this list the complex conjugates A*) of A in ([T]), and 
let TUi be the algebraic multiplicity of each A^. The real 
Jordan canonical form J of A then has the block diagonal 
structure J = diag(Ji,..., G where the block 

Ji G and detJ^ = Af% with 

_ { rrii if Ai G M 
1 2mi otherwise 


It is clear that we can equivalently study the following 
dynamical system instead of 0 


Xk+i = Jxk-^TBui (9) 


for some similarity matrix T. Let U = {1,..., d} denote the 
index set of unstable eigenvalues. 

Theorem 2: There exists a causal encoder/decoder pair 
such that the LTI dynamics 0 can be stabilized 
over the communication channel 0 in mean square sense if 


d 1 

y]/iilog|Ai| < --logE{ 


i=l 




cr; 


( 10 ) 


and only if (log|Ai|,..., log|Ac^|) G satisfy that for all 
Vi e {0, , rrii} and i e h/ 

.2 


y^ajViloglAil < --logE{( 

i&A 


crz. 


<+9?P 


)"} 


( 11 ) 


where v = ^i^n ciiVi, and = 1 if A^ G M, and = 2 
otherwise. 

Proof: For the proof of necessity, notice that each 
block Ji has an invariant real subspace Av^ of dimension 
OiVi, for any Vi G {0, Consider the subspace A 

formed by taking the product of the invariant subspaces Av^ 
for each real Jordan block. The total dimension of A is 
V = ^i^i^ciiVi. Denote by x^ of the components of x 
belonging to A. Then x^ evolves as 


Xfc+i = + QTuk (12) 

where Q is a transformation matrix and det 
Since Xk is mean square stable, it is necessary that the 
subdynamics OH* is mean square stable. Similar to the 
necessity proof in Theorem 1, we may derive the necessary 
condition O- And this completes the proof of necessity. 

Here we prove the sufficiency using the idea of Time 
Division Multiple Access (TDMA). Based on the previous 
encoder/decoder design for scalar systems, the following 


information transmission strategy is designed for the vector 
system. Without loss of generality, here we assume that 
Xi,... ,Xd are real and rrii = 1. For other cases, readers can 
refer to the analysis discussed in Chapter 2 of [1]. Specif¬ 
ically, under this assumption, J is a diagonal matrix and 
d = n. The sensor transmits periodically with a period of r. 
During one channel use, the sensor only transmits the estima¬ 
tion error of the j-th value of xq using the scheme devised for 
scalar systems. The relative transmission frequency for the j- 
th value of xq is scheduled to be aj among the r transmission 
period with = 1- The receiver maintains an array 

that represents the most recent estimation of xq, which is set 
to 0 for t = 0. When the information about the j-th value 
of Xq is transmitted, only the estimation of the j-th value of 
Xq is updated at the decoder side, and the other estimation 
values remain unchanged. After updating the estimation, the 
controller takes action as the one designed in Lemma If 
the diagonal elements of A^'E{ete^}{A'y converge to zeros 
asymptotically, i.e., for i = 1,..., n, limt^ooAf^Ejef^} = 0 
, the conditions in Lemma can be satisfied. Since the trans¬ 
mission is scheduled periodically, we only need to require 
that limfc_>ooAf'''^E{ef = 0, Vi = 1,..., n. Following 
our designed transmission scheme, we have = 

if < i for an 

i = 1,... n, the sufficient condition in Lemma can be 

satisfied. To complete the proof, we only need to show the 

2 

equivalence between the requirement < 1 

for all i = 1,... n and (TO^ . On one hand, since Yl^=i — 
1, if AfE{ ^ 2 ^^ 2 p }^' < 1 for all i = 1,... n, we know that 
( p^ holds. 6n the other hand, if ( p^ holds, we can simply 
choose ai = which satisfies the requirement that 

EILi = 1 and AfE{ ^ 2 p^ 2 p }^^ < 1 for all i = 1,..., n. 
The sufficiency is proved. ■ 


V. Numerical Illustrations 
A. Scalar Systems 

The authors in [8] derive the mean square capacity 
of a power constrained fading channel with linear en¬ 
coders/decoders. The necessary and sufficient condition for 
scalar systems is ilog(l H— Tpir^) > log|A| with jig and 
ag being the mean and variance of gt. We can similarly 
define the mean square capacity of the power constrained 
fading channel with linear encoders/decoders as Cmsl = 
|log(l + ^ 2 p^p ^2 )• Simply assume that the fading follows 
the Bemoufli distribution with failure probability e, then 
the Shannon capacity, the mean square capacity achievable 
with causal encoders/decoders and the mean square capac¬ 
ity achievable with linear encoders/decoders are given as 

C^ShannonsD ~ C^MSCrd ~ ~ 2 ( c3+P ) ’ 

CmSLbd = 5log(l + (i-7)%+al )- Por P 

the channel capacities are functions of e. Let P = 1 and 
= 1, the channel capacities in relation to the erasure 
probability are plotted in Fig.[^ It is clear that CshannonsD ^ 
C'msCbd ^ C'msLbd given erasure probability e. This 
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Fig. 2. Comparison of different channel capacities when P = 1, = 1 


result is obvious since we have proved that the Shannon 
capacity is no smaller than the mean square capacity with 
causal encoders/decoders. Besides, we have more freedom in 
designing the causal encoders/decoders compared with the 
linear encoders/decoders, thus allowing to achieve a higher 
capacity. The three kinds of capacity degenerate to the same 
when e = 0 and e = 1, which represent the AWGN channel 
case and the disconnected case respectively. 

B. Vector Systems 

Consider the two dimensional LTI system with J = 
[ A 2 ] ’ communication channel is in which 

the fading follows the Bernoulli distribution with failure 
probability e. In view of Theorem a sufficient condition 
to ensure mean square stabilizability is that (log|Ai|, log|A 2 |) 
should lie in the region of logjAi | +log|A 2 | < CmsCbd- The 
necessary requirement is given by the following region in 
(log|Ai|,log|A 2 |) plane 

{ log |Ai| < CmSCbdj log IA 2 I < CmSCbd 

log|Ai|+log|A 2 | < -log (e+(l-e)( )") 

The necessary and sufficient condition to ensure mean square 
stability using linear encoders/decoders for this system is 
given in [8], which states that (log|Ai|, log|A 2 |) should be 
in the region constrained by log|Ai| + log|A 2 | < CmsLbd- 
Selecting P = 1, = 1 and e = 0.8, we can plot the 

regions for (log|Ai|, log|A 2 |) indicated by the sufficiency 
and necessity in Theorem and that indicated in Theorem 
3.1 in [8] in Fig. We can observe that the region of 
(log|Ai|, log|A 2 |) that can be stabilized with the designed 
causal encoders/decoders in Section IV is much larger than 
that can be stabilized by linear encoders/decoders in [8]. 
Thus by extending endocers/decoders from linear settings to 
causal requirements, we can tolerate more unstable systems. 

VI. Conclusion 

This paper characterized the requirement for a power con¬ 
strained fading channel to allow the existence of a causal en¬ 
coder/decoder pair that can mean square stabilize a discrete¬ 
time LTI system. The mean square capacity of the power 
constrained fading channel with causal encoders/decoders 
was given. It was shown that this mean square capacity is 
smaller than the Shannon capacity and they coincide with 
each other for some special situations. Throughout the paper, 
the capacity was derived with the assumption that there 



Fig. 3. Stability region of (log|Ai|, log|A 2 |) indicated by Theorem 2 for 
a vector system 


exists a perfect feedback link from the channel output to 
the channel input. What would the capacity be for power 
constrained fading channels when there is no such feedback 
link or there is only a noisy feedback link is still under 
investigation. 
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